Abstract: Incremental learning mode is meaningful to efficiently learn new information without forgetting previously acquired knowledge and without requiring access to the original database. The incremental learning principles of feedforward neural networks and feedforward neural network ensembles are expounded. The main incremental learning algorithms based on the principles are introduced and analyzed in detail. Finally, the future direction of incremental learning is depicted.

Key words: pattern recognition, neural networks, incremental learning